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We show that study of the atmospheric neutrinos in the 10-100 GeV energy range by DeepCore 
sub-array of the IceCube Neutrino Observatory can substantially constrain the mixing of sterile 
neutrinos of mass ~ 1 eV with active neutrinos. In the scheme with one sterile neutrino we calculate 
v^— and v^— oscillation probabilities as well as zenith angle distributions of u^ c (charge current) 
events in different energy intervals in DeepCore. The distributions depend on the mass hierarchy 
of active neutrinos. Therefore, in principle, the hierarchy can be identified, if v s exists. After a few 
years of exposure the DeepCore data will allow to exclude the mixing |C/ M 4| 2 > 0.02 indicated by 
the LSND/MiniBooNE results. Combination of the DeepCore and high energy IceCube data will 
further improve sensitivity to v s mixing parameters. 
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I. INTRODUCTION 

Mixing of sterile neutrinos of eV mass scale with active 
neutrinos, as is indicated by the LSND/MiniBooNE re- 
sults [U |5] , significantly affects the atmospheric neutrino 
fluxes J3HZ] . The primary effect arises in the TeV energy 
range due to the MSW resonant enhancement of v^ — v s 
oscillations while neutrinos pass through the matter of 
the Earth. As a result, the v^— flux, and consequently, 
number of v^— events at the detectors deplete. The oscil- 
lations lead to distortion of the zenith angle and energy 
distributions of events. 

In this paper we will show that the atmospheric neu- 
trino fluxes at low energies, E < 0.5 TeV, are also 
strongly affected by the v s oscillations in spite of the 
fact that the resonance enhancement occurs in the TeV 
range. Therefore studies of the low energy fluxes can 
substantially contribute to searches for sterile neutrinos. 
With a densely spaced array of phototubes in the middle 
of the IceCube array, DeepCore sub-array [5] , [H] signif- 
icantly enhances IceCube sensitivity to (10 — 100) GeV 
neutrinos. This makes possible to study the atmospheric 
neutrino oscillations with DeepCore at low energies [TOT - 

njg. 

As it was realized in Ref. [5], the v s effects depend 
not only on U^ relevant for the LSND/MiniBooNE re- 
sults but also on the v T admixture U T t±. There are two 
special cases: (i) U t a = 0, which corresponds to the so 
called flavor-mixing scheme, and (ii) C/ T 4 = U^ which 
determines the mass-mixing scheme for maximal 2-3 mix- 
ing. In the latter case v s mixes with the active neutri- 
nos through the mass eigenstate v%. At energies below 
0.5 TeV in the v s mass-mixing scheme the v s effects are 



strong, whereas in the v s flavor-mixing scheme the oscil- 
lation probabilities are unaffected [5]. In this paper for 
illustration we consider a scheme with one sterile neu- 
trino, as was favored by recent MINOS data (TU [T3] and 
global fit [T5] and focus on the v s mass-mixing scheme. 
We show that the mixing angle with the active neutri- 
nos can be significantly constrained by (10 — 100) GeV 
atmospheric neutrino data collected in DeepCore [5]. 

We present oscillation probabilities in the v s mass- 
mixing scheme at low energies in Sec. II. In Sec. Ill we 



calculate the 



,cc 



event rate in DeepCore produced by 



atmospheric neutrinos. We study the zenith and energy 
distributions of these events. We estimate the sensitivity 
of DeepCore to the v s mixing with active neutrinos in 
Sec. IV. Sec. V contains discussion and conclusions. 



II. OSCILLATION PROBABILITIES 

At high energies to a good approximation one can con- 
sider mixing of the three flavor states vj = [v s ,v T ,v^) 
in the mass eigenstates v^ nass = {v i ,v 3 ,v 2 ), neglecting 
the mixing of v\ 5J. In the v a mass- mixing scheme, the 
mixing matrix Uf, defined as Vf = U jv mass , depends on 
the angle #23 and new "sterile" angle a, so that in 1/4 

U S 4 — cos a, C/p4 = sin a sin #23, U T 4 — — sin a cos #23- 

For a = 0, when the state v^ decouples and the 
v— evolution reduces i 
probability is given by 



3v— evolution reduces to 2v— evolution, the v^ survival 



P„ 



1- sin 2 2fe sin 2 Am323; 



IE 



(1) 
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Here x = 2i?® | cos Z | is the length of neutrino trajectory 
characterized by the zenith angle 9 Z , and -R® is the ra- 
dius of the Earth. In our numerical estimations we use 
Am| 2 = (2.3 - 2.5) • 10~ 3 eV 2 and sin 2 26> 23 = 1. 



According to Eq. |l]) the first oscillation minimum 
(dip) is at energy 



E 



-Am 32 i?® cos 6* z 



(2) 



For neutrinos moving along the Earth's diameter, 9 Z = n, 
we obtain £° ln « 25.7 GeV. 

If a 7^ 0, the oscillation probability changes substan- 
tially due to matter effect. For E > 15 GeV to a good 
approximation the effect is described by oscillations in 
uniform medium with the average density along the neu- 
trino trajectory. In turn, for constant density and for 
energies below 0.5 TeV the probability is given by [5] 



P„ 



I — cos 2 a sin 2 26*23 



x sin 



^^±\V^(9 Z )\ sin 2 a j /,' <•«,.;,<-;. 



-0.5 sin 2 2a sin 4 23 - 0.5 sin 2 a sin 2 20 23 , (3) 

after averaging over fast oscillations driven by the mass 
squared difference Am 2 3 ~ 1 eV 2 . Here V^(9 Z ) is the 
average matter potential: V^(9 Z ) = —Gpn n (9 z )l\f2, and 
n n (9 z ) is the average number density of neutrons along 
the 9 Z trajectory. The lower "— " (the upper "+") sign 
in front of \V^\ in Eq. (|3|) corresponds to antineutrinos 
(neutrinos). Thus, in the first approximation the v s ef- 
fect is reduced to appearance of an additional contri- 
bution to the oscillation phase. This contribution has 
different signs in the v— and v— channels as well as for 
normal (NH) and inverted (IH) mass hierarchies of the 
active neutrinos (i.e. for the positive and negative signs 
of Am! 2 ). 

According to Eq. p| the energy of the first oscillation 
dip changes due to v s mixing as 



EL 



|Am 2 2 | 



^-^ w - T 2\V^co S 9 z )\sm 2 a 



E { . 



IT : 2 :|V M (cos0 z )|i? e sin 2 acos0 z ' 



(4) 



where the lower sign in denominator corresponds to an- 
tineutrinos for the normal mass hierarchy and to neutri- 
nos for the inverted mass hierarchy. For sin 2 a = 0.04, 
fixed Am| 2 , NH and cos9 z = — I (an average density 
~ 8.4 g cm" 3 ) the oscillation dips are at 29.0 GeV and 
22.4 GeV for neutrinos and antineutrinos, respectively. 
This v s induced shift of the u^ — v^ oscillation dip can 
be used to constrain the mixing angle a. 

We computed the oscillation probabilities as functions 
of neutrino energy and zenith angle by numerically solv- 
ing the Zv— evolution equation [5] with the density pro- 
file given by the Preliminary Reference Earth Model [IH] • 
The features of the obtained results can be easily under- 
stood with Eqs. to Q. 

Figure U\ shows the v^ — > v^ (top panel) and v^ — > v T 
(bottom panel) oscillation probabilities as functions of 
neutrino energy for different Am 2 3 but fixed zenith angle 
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FIG. 1: Oscillation probabilities i/ M — > v^ (top panel) and 
ff, — ► v T (bottom panel) for different values of A77143. The 
solid (broken) lines correspond to the probabilities without 
(with) v a mixing. The normal mass hierarchy is assumed. 



1 


~ / ■ V 
" / -■ V y 
- . \f/ 

7 ■/*% 

4/y \\ 
¥■- V 

ri v 
\ V 




1 ' 


' 


0.8 
0.6 

0.4 


y. ." / ' / '/** 

/■■/'/ ■■••■'' 




0.2 


1 v 


\ \ '■ 

t\ \ / 

V X 1 - 
\yy \ 


/■" / ' / 
"' / /J / 
// / .■" 


sin a = 0.04 ; 
Am^= 1 eV 2 ; 



ia, : 



0.6 

0.4 p.; 

0.2 


10 



'\V"A \ 

- jY '*. \ 

~'A\ ■- \ 

■ \\ jr\ 

i/'\ ''■ 

f \\ ; 

i\ v \ ' 
\ A 

H v\ A 

■\ * \ 

- *\ v \ 
■\ •/ ^ 

~ ^y Vs. _ 




-j^j^P^t^ V-cr " 7 ^"-- v "*' ' ' ■' 


Js-'XX 

\ ~/- "/ lv y / 
\ y/ ■'/ i ■/ / 
\ V V */ / 
\y ""/ '~/' / 
'S\ •/ '/ / 

■ \ ■/ / /' / 
■ \ // '/■' / 

• \.y //-' / 


... cos0 =-1.0 

z 

-- cos 9 =-0.8 

Z 

-. cos 9 =-0.6 

Z 

. - . cos 9 = - 0.4 

Z 

-.. cos 9 =-0.2 

Z 


: 


\x- xV**' s 




- 



£(GeV) 



10 



FIG. 2: The survival probabilities of v^ (top panel) and i? M 
(bottom panel) for different values of the zenith angle. The 
solid (broken) lines correspond to the probabilities without 
(with) v s mixing. The normal mass hierarchy is assumed. 



Z = it. The energies of the oscillation dips are in good 
agreement with the approximate values from Eqs. (pi) and 
Q. According to Fig. [lithe energy of resonant oscil- 
lation dip in the ^—channel is proportional to Am 2 3 . In 
contrast, at energies < 100 GeV the probabilities depend 
on Am 2 3 very weakly, which can be seen explicitly in Eq. 
([3]). From the bottom panels, we find that at low ener- 
gies v„ mainly transforms to v T , whereas at high energies 
Ufj, — > v s transition is significant. 
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FIG. 3: The v^— and v^— survival probabilities for two 
different absolute values of Am^. Top panel: normal mass 
hierarchy, Am§ 2 > 0; bottom panel: inverted mass hierarchy, 
Am§ 2 < 0. Thin lines are for probabilities without v s mixing. 



Figure shows the probabilities P M/J and P MM as func- 
tions of neutrino energy for different values of cos 9 Z , but 
fixed sin 2 a and Am 2 3 and for NH. With decrease of 
| cos 9 Z | the length of the neutrino trajectory decreases 
and E min becomes smaller. Furthermore, the difference 
of probabilities with and without v s decreases. 

In Figure [3] we show dependence of the survival prob- 
abilities on the absolute value of Am| 2 and on its sign, 
i.e. on mass hierarchy of active neutrinos. A variation of 
Am§ 2 also shifts the dip. However, due to dependence of 
V on 9 Z and energy dependence of the usual (ex Am§ 2 ) 
term in Eq. |3]) the effects of Am^ variations and of 
sterile neutrino are different. Thus, studies of the energy 
and zenith angle dependence of the v^ event rates will 
allow to disentangle the two effects. Change of the mass 
hierarchy leads to interchange of v and v probabilities 
at low energies. As a result, for IH the v probability is 
below the v probability in whole energy range, and there 
is no intersection of the two at 0.5 - 0.7 TeV. As follows 
from Figure K5j the effect of Am^ uncertainty (within 
68% CL region allowed by the MINOS results [T7]) on 
the probabilities, is relatively small. However, it becomes 
significant when events from v and v interactions sum up. 



III. EVENT RATES IN DEEPCORE 



We calculate the 



,cc 



(charged current) event rate 



in DeepCore. The v^— flux at the detector equals $ M = 



<J>° P 



-*2p, 



e/z 



$"F W , where the original atmospheric 



v^— flux, &®, is larger than the original v e — flux, $^, by 
a factor > 10 in the energy range under consideration. 
Furthermore, P e{i <C 1 and v e mostly converts into v s [5]. 



So, we will neglect the effect of v e — ¥ v^ transition. How- 
ever, we do take into account contributions from the tau 
leptons, created by the v T N interactions. Tau leptons 
decay into muons with branching ratio e ~ 0.f8 being 

The v T — flux at the detector 



,CC 



recorded as z^° — events 
$o p 



equals $ T 



To be detected as a v. 



cc 



event 



in the same muon energy bin the v T energy needs to be 
r\ ~ 2.5 times higher than a f„ energy. Thus, the rate of 
v^ c — events in the neutrino energy and zenith angle bin 
ij equals 



N, 



1,3 



2?r 



dcos9 z / dE A cS (E,6 z 



A<E 



x [*l(E, e z )P^(E, 9 Z ) + 9l(r,E, 9 z )eP^( v E, 9 Z )} 
+ antineutrinos. (5) 

We use the DeepCore "Filter" effective area A e g from 
Ref. [5] and the atmospheric neutrino fluxes model of 
Ref. [15] , The DeepCore effective area is largely insensi- 
tive to the zenith angle [20] so that A e g(E, 9 Z ) ra A a s(E). 
The contribution of the r— decays to the total ^ c — event 
rate (the second term in Eq. (p>|)) is < 5%. Since 



at low energies secondary leptons from the vN interac- 
tions are scattered at larger angle from the directions 
of the primary neutrinos, we use large zenith angle bins 
Aj(cos(?z) = 0.2, as compared to the bins for > 100 GeV 
data [3T]. We assume that for v^ c events the neutrino 
energy will be reconstructed with factor of 2 accuracy 
which implies detection of both muon and the associ- 
ated (hadron) cascade. Therefore we use the energy bins 
AjE = (E-T-2E). 

Figure [i] shows the zenith angle distributions of 
v^ c — events at DeepCore in different energy intervals. 
The histograms represent the event rates with v s and 
without v s mixing correspondingly for NH (left) and IH 
(right) . The rates decrease with increase of | cos 8 Z \ which 
reflects the dip in the oscillation probability. The de- 
crease is steeper in the low energy range which covers 
the minimum of the dip. With decrease of the v s — mixing 
the difference of histograms decreases as sin 2 a. Due to 
summation of the neutrino and antineutrino signals the 
total v s — effect on the number of events is smaller than 
the effect on probabilities. Still the compensation is not 
complete due to difference of the original fluxes and cross- 
sections of the neutrinos and antineutrinos. For IH the 
effect is smaller than for NH, especially for deep (near 
vertical) trajectories. The reason is that for IH relative 
deviation of the v survival probability from that without 
v s — mixing is smaller than deviation for v probability (see 
Fig. p3j) . This is compensated by larger flux and cross sec- 
tion of v. Notice that difference of the event numbers in 
each of the zenith angle bins can reach 2 - 3 a after 1 
year exposure. 

We define the suppression factor as the ratio of the 
rate Nij with v s — mixing to the same rate without v s 
mixing (see also Ref. [5]). Figures [5] and [6] show the sup- 
pression factors as functions of zenith angle in different 
v^ energy ranges for NH and IH correspondingly. As can 
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FIG. 4: The u? event rates in different energy and 
zenith angle bins at IceCube DeepCore. The histograms 
with thick lines correspond to events with v s — mixing while 
the histograms with thin lines correspond to events without 
v s — mixing. Left panel: normal mass hierarchy, right panel: 
inverted mass hierarchy. 



FIG. 5: The suppression factor of isjj — events as function of 
the zenith angle for different energy intervals and two values 
of A7TI32 (top and middle panels). The bottom panel shows 
the ratio of event rates for two different Am§ 2 without sterile 
neutrinos. The normal mass hierarchy is assumed. 



to enhanced v^— survival probability P w , 



be seen from Fig. [5] for NH the v s mixing mostly af- 
fects the vertically upcoming events in the lowest, 15-30 
GeV, energy bin. The excess of events in this bin is due 

near the oscil- 
lation minimum at ~ 30 GeV (see Figs. [T]and[2]). For 
IH (Fig. [6]) the next bin (—0.8 -. — 0.6) rate is equally 
affected. The distributions depend on Arn| 2 weakly. 

In the bottom panels of Figures [3] and [6] we show pos- 
sible modification of the ratio due to inprecise knowledge 
of Am| 2 . This is illustrated by the ratio of the two distri- 
butions without v s for two different values of Am§ 2 : the 
"true" (observed) value and the "fit" value. Variations of 
Am§ 2 produce shift of the dip and therefore qualitatively 
similar distortion of the ratio. Quantitatively the effects 



arc different: the effect of Ar 



':S2 



variations is smaller than 



the one of v s at high energies. For IH and | cos9 z \ > 0.4 
the two effects have opposite signs, etc.. In analysis of 
data one should use Amj^ as fit parameter varying in the 
range allowed by accelerator experiment measurements. 
In future Am§ 2 will be determined with accuracy 10~ 4 
eV which will substantially reduce the uncertainty. 
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FIG. 6: The same as in Fig.[5]for the inverted mass hierarchy. 



IV. ESTIMATION OF SENSITIVITY TO 
MIXING 



To estimate sensitivity of the DeepCore to sterile neu- 
trinos we perform a simple \ 2 analysis of the data gen- 
erated in assumption of zero v s mixing. We assume that 
Amg 2 is known precisely. We fit these "data" with num- 
ber of events obtained in the presence of v 8 — mixing. To 



take into account possible systematic errors, as in Ref. |5J, 
we introduce an overall normalization factor C and a tilt 
parameter r for the zenith angle distribution of the event 
rates in Eq. ^ as 

N™? d (C, r; sin 2 a) = C[l + t(cos 9 t + 0.5)] JV* 3 (sin 2 a). 

(6) 
We use Arn| 3 = 1 eV 2 . Defining the "null" distribu- 
tion of zenith angle events without v s — mixing as Nfj = 



TABLE I: Minimal value \ 2 and the corresponding values 
of the normalization C and tilt parameter r from the anal- 
ysis of the tentative energy and zenith angle distributions of 
DeepCore event rates with and without v a mixing. The values 
within brackets are calculated using 5% uncorrelated system- 
atic uncertainties in addition to the statistical and overall nor- 
malization uncertainties. The analysis is performed for two 
different values of mixing angle a and two exposure times. 



sin 2 a 


Exposure 


Amin 


C 




r 


0.02 

(NH) 


1 yr 
5 yr 


7.62 [3.47] 
38.1 [5.59] 


1.03 [1.03] 
1.03 [1.03] 


-0.03 
-0.03 


[-0.02] 
[-0.02] 


0.04 

(NH) 


1 yr 
5 yr 


41.1 [18.7] 
205 [29.7] 


1.06 [1.06] 
1.06 [1.05] 


-0.05 
-0.05 


[-0.02] 
[-0.00] 


0.02 
(IH) 


1 yr 
5 yr 


4.50 [1.84] 
22.5 [2.92] 


1.00 [1.00] 
1.00 [1.00] 


0.04 [ 
0.04 [ 


0.04] 
0.04] 


0.04 
(IH) 


1 yr 
5 yr 


14.8 [5.49] 
73.8 [8.47] 


1.01 [1.01] 
1.01 [1.00] 


0.09 [ 
0.09 [ 


0.10] 
0.10] 



Nij(C = 1, t — 0; a = 0), we calculate x 2 value as 



X 2 (C,t, sin 2 a) = 



[N, 



null 



Ntf d (C,T, sin 2 a)] 



i,j 



xrnuU 
h3 



(7) 



Then \ 2 is minimized by varying C and r. The results, 
Xmin an d the corresponding values of C and r are listed 
in the Table [I] for 1 yr and 5 yr of exposure and for two 
different values of sin 2 a. According to Fig. J4j already 
after 1 year of data taking the statistical error in each 
bin is expected to be ~ (2-4)%. However, as pointed 
out in Ref. [7] , systematic errors for IceCube are not well 
defined yet and will likely dominate statistical errors. To 
illustrate this effect on the sensitivity to v s we performed 
X 2 analysis by introducing a 5% uncorrelated systematic 
error for each bin in addition to the statistical and cor- 
related systematic (slope and normalization) errors. The 
values of x 2 an d (C, r) in this case are reported in Ta- 
ble |l] within brackets. The x 2 values in the Table should 
be compared with Xmin = ^ which corresponds to zero 
mixing with v s . 

For NH the obtained x 2 values with 2 degrees of 
freedom mean that even with 5% additional system- 
atic uncertainties, sin 2 a = 0.04 or | C/ p 4 1 2 = 0.02 can 
be excluded at > 99.9% CL with one year of Deep- 
Core data. As a result, the oscillation interpretation of 
LSND/MiniBooNE data [HID that requires |C/ m4 | 2 > 0.03 
for Am 2 3 < 1 eV 2 will be severely constrained. 

In the case of sin 2 a — 0.02 or |(7 M 4| 2 = 0.01 five years 
of DeepCore data would be required to reach ~ 95% CL 
for exclusion. This is comparable with the current bound 
from the MINOS experiment .14] . A mixing angle smaller 
than sin 2 a ~ 0.02 cannot be excluded with DeepCore 
data alone. For IH the effects is substantially smaller 
and only |C/^4| 2 > 0.02 can be tested. 

We estimate that the present uncertainty in Am 2 2 re- 
duces the sensitivity to v 8 — mixing by factor of 2, i.e. 
| t/ M4 1 2 = 0.02 (for NH) can be excluded at > 99.9% CL 
after 4 years of the data taking. 



V. DISCUSSION AND CONCLUSION 

A combined analysis of the IceCube high-energy data 
which cover the MSW resonance dip at TeV energies, 
together with DeepCore low energy data will improve 
greatly the sensitivity to v s mixing parameters. Further- 
more, a distinction between the flavor- and mass-mixing 
schemes will be possible since DeepCore event distribu- 
tions are affected in the case of mass-mixing only, as we 
have studied here, while the IceCube event distributions 
are affected in both mixing schemes [5]. 

Notice that search for sterile neutrinos with IceCube 
and DeepCore are complementary to that with MINOS 
and other accelerator experiments. Indeed, IceCube mea- 
sures the mass squared difference and mixing at much 
higher energies and with large matter effect. In scenarios 
with energy and enviroment dependent neutrino masses, 
the mass and mixing parameters may turn out to be sub- 
stantially different in this two setups. 

We considered the oscillation effects for specific mixing 
scheme and specific values of parameters and presented 
an illustrative analysis of simulated data. General anal- 
ysis would include the sub-leading effects of the non-zero 
1-3 mixing, possible effects of the CP-violation associated 
to existence of sterile neutrino, consideration of different 
values of |-7 t4 |, etc. 

In conclusion, we have found that mixing of the eV 
scale mass v s indicated by LSND/MiniBooNE, substan- 
tially affects the oscillation probabilities in the range 15 
- 120 GeV accessible to IceCube DeepCore experiment. 
The effect is opposite in v— and v— channels and can 
reach ~ 0(1) size at the probability level. The v s mix- 
ing produces a shift and modifies shape of the oscillation 
dip. The effect is different for the normal and inverted 
mass hierarchies of the active neutrinos. Therefore, in 
principle, the hierarchy can be identified, if the sterile 
neutrinos with relatively large mixing exist. The zenith 
angle distributions of the vr° events in different energy 
ranges are changed. However, due to summation of v— 
and v— signals the effect of v s — mixing and oscillations 
on the number of events is much weaker. Uncertainty in 
Am| 2 reduces sensitivity of DeepCore to sterile neutri- 
nos. Nevertheless we find that Deep Core can probe the 
v s mixing down to U^ = 0.01 — 0.02 for wide range of 
Am| 3 . 
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